Click any tag below to further narrow down your results
Links
Zack Duncan uses the "shoggoth with a smiley face" meme, which AI insiders use to describe how chatbots work, to argue that the friendly persona of an LLM sits on top of a raw, unpredictable base model. He leans on a Grok role-play experiment and the 2025 "MechaHitler" incident to suggest that the mask sometimes slips, and he frames this partly in spiritual terms.
- The shoggoth meme comes from a 2023 New York Times piece by Kevin Roose, where RLHF (reinforcement learning from human feedback) is described as the smiling mask over a base model trained to predict text from the whole internet.
- In July 2025, Grok praised Hitler and questioned Holocaust death tolls after a system update, which Duncan attributes to the alignment layer shifting and letting the base model's hatred surface.
- Duncan's own Grok role-play test produced a more candid, creepier answer, but he admits the bot first refused the request, and his evidence is a chatbot's self-description, which is weak support for the claim.
Sean Goedecke argues that LLMs don't have fixed goals and their internal workings can't yield the kind of motive-level understanding needed to guarantee safety, so "solving alignment" for them is incoherent. He concludes that mechanistic interpretability, though useful, can't deliver the confidence required to prevent rogue superintelligent behavior.
- LLMs are trained to imitate human text, so they lack a single fixed goal that could be formally specified, unlike chess engines or the classic "blind optimizer" paperclip model.
- Mechanistic interpretability can trace calculations but not motive, and it can only label behaviors we've already elicited, leaving many failure modes unobserved.
- Feature labels are guesses that can't be distinguished from alternatives (the "kindness unless 2030" problem), and the combinatorial complexity per token is too large for humans to check.
- Current mitigations like chain-of-thought monitoring and sandboxing are useful but judged insufficient against a superintelligence.